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ABSTRACT 



Beginning with a brief review of the growth of the 
audiolingual method of foreign language instruction in the United 
States of America, this paper examines implications and lessons drawn 
from an educational experiment in language instruction known as the 
Pennsylvania Report. The text of a memorandum to school 
administrators in Pennsylvania by the Superintendent of Public 
Instruction discusses the project in which 104 beginning French and 
German classes from 66 participating school districts in the two-year 
educational experiment attempted to determine the effectiveness of 
the audiolingual method of language instruction. Achievement of 
students trained in the audiolingual method and the traditional 
method is compared and other factors bearing on achievement are 
commented on. Teacher qualifications, the use of the language 
laboratory, and commonly accepted theories of language instruction 
are critically examined. {RL) 
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A STUDI IN DISESTABLISmiENTARIANISM — LESSONS AND 
IMPLICATIONS FROM THE PENNSYLVANIA REPORT 



By I96U the audio-lingual crusade had been won, Bnerging from 
insights into linguistics and psychology pf the 19 U 0 *s and 19 ^ 0 ’ s, the 
"new key" approach to foreign language had become tne accepted system, of 
second language teaching in the United States, As the Nevada State Super- 
visor I was a minor baronet, . All of the secondary schools in my state had 
language laboratories — — all but one remote hold— out had adopted materials 
reflecting the new approach. 



Unfortunately, with success the zealot becomes the establishment. 
By 1968 the audio— lingual approach was called the American approach. 

Such wide-spread acceptance had not come without words of caution, 
not only from those we "Young Turks" regarded as conservative hide-bound 
traditionalists but from such respected scholars and thinkers as David 
■ Ausubel and John Carroll, As late as I966 Nelson Brooks characterized 

- the audio-lingual movement as "an act of faith," 

There was little or no research to support the assumptions on 
which we acted. The initial assessment of the approach by Agard and Dunkel 
in I9U8 was rather subjective and the evaluation pre-dated adequate tests 
that were not available until the developnent qf the tape recorder. The 
Scherer— Wertheimer study 'in Colorado was hailed as proving that the audio- 
lingual approach was superior to a more traditional one. When I became 
khqwledgable enough in research to read the report itself I found that such 
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enthusiastic support for tne method was not at all to be foiuid in the data 
presented by the authors. So much was obviously wrong with the Keating 
Report that none of us ever bothered to find put if some good might have 
been derived from it. 

In 1963 the Keating Report stimulated the state of Pennsylvania 
to undertake a large-scale assessment of the audio-lingual approach as it 
was being implemented in the public schools of the Commonwealth. It is 
not my purpose here today to detail to you the history of the study. Per- 
mit me, however, to review for you briefly the main points as they were 
disseminated last year to school superintendents throughout the state of 
Pennsylvania. 

Adapted from SCHOOL AMINISTRATOR* S l-IMORAHDUl^ 

Subject; Foreign Language Research May 12, 1969 

To; Chief School Admini.strators 

From: David H. Kxirtzman, Superintendent of Public Instiniction 

The Pennsylvania Department of Education in cooperation with 

West Chester State College has completed a statewide four-year foreign 

language study which is having an impact both nationally and internationally 

The study challenges ths effectiveness of both the audiolingual teaching 

approach and the language laboratory as they, are implemented in the typical 
0‘ ■ 

secondary school situation in Pennsylvania. The experiment involved lOU 
beginning French and German classes from 66 participating school districts 
for the first year. Fifty classes continued in the project for the second 
year of the. study© 



Experimental classes were taught utilizing an updated " traditional” | 
"audiolingual,” and a composite audiolingual “with grammar" approaches. All 
audio lingual classrooms were ^equipped with a tape recorder Tor daily use. 

In addition, randomly selected classes spent two half-hour periods each week 
in a listen-respond or listen-record language laboratoiy. 

A select group of nationally known foreign language educators 
defined the contrasting teaching strategies and identified representative 
texts for each. Teachers were trained in their assigned method, extensively 
tested, and observed for adherence to their assigned approach. Instructional 
materials were limited to widely accepted commercially published programs. 

Almost 2,200 students completed 28 pre- and post-measures diiring the 
first year. Pre-experimental measures included intelligence, foreign language 
aptitude, student opinion and achievement. Final measures for all students 
included both the 'traditional" 1939/hl Cooperative Tests of reading, vocab- 
ulary, and grammar as well as the contemporary Modem Language Association 
Cooperative Classroom Tests of listening .'and reading. A ten percent random 
sample of each class took additional tests on speaking and writing skills. 

One thousand, one hundred (l,100) of the same students were observed 
as ’they continued the experiment through French and German II . In addition, 
an independent seven hundred (700.) c^student, twenty-eight (28) class, repli- 
cation was undertaken to confina the first year findings. Procedures, ma- 
terials and testing remained essentially the same. 

The extensive statistical analyses were carried out under the 
supervision of a consultant from the University of ^'^aryland. Results of 
the two-year experimental* phase include: 

lo” Traditional classes" achieved significantly better than "audio- 
lingual” classes on measures of grammar, vocabulary, and read- 
ing and writing. No significant differences occurred in listen— 
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±ng tmd speaking. No advantage was found for "beefing" up an 
audiolingual apj^roach with formal grammar sianmations# 

Neither the audio— active or ‘audio— active— record language labora- 
tory systems had any discemible effect on foreign language 
achievement in either listening or speaking wnen the laboratory 
was used twice a week for half a class period. 

3* Teacher proficiency scores did not correlate with student 

achievement scores after one, two, or even four years of daily, 
classroom contact. 

Continuation of tne study tnroiigh the third and fourth years of 
language study confirmed the results favoring the "traditional" approach* 

Three separate reports of the study were submitted to the U.S. 
Office of Education and are now available to the profession in a single 
voliime. 

The Pennsyl\'ania Reports have been" cussed and discussed" and will 
probably continue to be so for some time, ^t has been most gratifying to 
me personally to read John Carroll’ s statement in the December 1969 Foreign 
Language Annals that he considers the findings of the study in regard to 
teaching methodologies to be valido 
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It is not my purpose here today to defend the Pennsylvania Studies 
bu*t raiher "bo poini oui bo you some of bhe lessons bhab I have learned 

being involved wibh bhis projecb* Some of bhem &pply bo bhe profession 
as a whole while obhers have some direcb implicabions for you in bhe class— 
room* 
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Our professional knowledge lag has been very forcefully brought 
. home to me# The first of the Pennsylvania Reports was disseminated only to 
concerned professionals for 6 months before it was made public, with abso- 
lutely no reaction from the profession despite this advanced wajming that 
findings were unfavorable to the audiolingual approach# After acceptance 
by the United States Office of Education the results of the Pennsylvania 
Studies were made public# It took only a few weeks for the public press 
to widely disseminate the results; it took from one to two years for our 
professional Journals to do so# \^en reaction finally did come from the 
profession it was both subjective and inaccurate. The State Supervisors 
of Foreign Language were informed by the reviewer they had appointed that 
the Pennsylvania Study had not included tests of speaking# This in fact 
was not so, as the text and report plainly indicated# An authority on 
language laboratories pointed out in 1968 that laboratory usage twice a 
week was ”the minimum effective#*' In 1969^ iu reaction to the Pennsyl - 
“ vania Study, this same educator referred to language laboratories two times 
per week as **shbotage#** The second lesson I learned from the study, then, 
was that ** Hell hath no fury like an audio-lingualist scorned#** 

I have come to the conclusion that even the best of us play what 
Jakobovits calls the **data game#** In our professional dealings supportive 
research is alluded to but not always clearly cited# Studies *which support 
our own hypotheses are accepted while contrary studies are either omitted 
or rationalized as being invalid# A study done with two or three classes 
in a laboratory school wliich supports our particular bias is valid but one 
with a hundred classes in a real school setting is not© 
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It is evident that more is read into research • including the 
Pennsylvania Studies — than should be. It is also clear that we as . 
foreign language educators need a greater consumer sophistication and a 
greater availability of research findings o Much lip service is paid to 
rese^ch but research has very little effect on the actual classroom 
practice. 

An almost heart-rending lesson in this was given to me by the 
Pennsylvania schools that peirticipated in the project. Wien they were 
iriformed that the use of the language laboratory twice a week in their 
own school situation did not enhance achievement, they did not modify 
their cuirriculum pattern in any way. Follow-up studies indicated that 
they continued to schedule language laboratory practice 341 a way that was 
known to be ineffective. 

Another lesson that I have learned about us as a profession is 
that we have a tendency to assume ^'protective coloration.” I was greatly 
surprised at the large number of people who approached me after the Study 
was released to be sure that I knew th^t they had had their reservations 
about the audio-lingual approach all along. I cannot place myself in this 
category© In I96U I. was convinced that the audio-lingual approach was the 
only way to effectively teach foreign languages. I was shocked when the 
computer results of the Pennsylvania Study were given to me. I. was so 
shocked that I refused to accept th^ and checked them through several 
times on different computers. This has spurred me to reassess my o>m posi= 
tion unt 4.1 I have finally reached the point wnere I realize that method is 
probably the least important variable in classroom instmetion, 
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I see a number of implications for direct application at the class- 
room level* The first is that the finding of great variance among classes 
within the same general teaching strategy often overshadows differences . 
between teaching strategies* This is to say that perhaps 30 to iiO/5 of 
foreign language achievement can be directly attributed to inherent student 
or teacher factors such as aptitude, inte3-ligence, personality, and moti- 
vation* Carroll has pointed that our studies indicate that only 3 to 
of foreign language achievement may be attributed to one method or another* 
There is a strong implication here for creating materials that are flexi- 
ble, providing for a variety of learning styles among individual students* 
The second implication is for placement of students in advanced courses by 
testing rather than assuming that teachers at an earlier level are achiev- 
ing roughly the same goals. 

The Modem Language Association Cooperative Classroom Tests which 
were used in our study provoked Valette ( MLJ^ Dec* 1969) to do a closer 
analysis of their content* She has shown that the I'lLA tests favor certain 
textbooks* The implication for this is that placement tests need to be 
course and text specific, validated on students within your particular 
school system* Another implication is that generalized proficiency tests 
should be criterion referenced, aiming at specific language behaviors, ra- 
ther than as general tests of achievement* Text developers have the obliga- 
tion to provide a graded series of serial measurements of specific behaviors 
for the teachers utilizing their materials. To date only one widely used 
foreign language text, Voix et Image» has undertaken such an ambitious pro- 
ject* Teachers utilizing this program receive ~ via computer analysis — 
specific insights into the mastery or weakness of individual students on 
very specific linguistic items* 



One finding of the Pennsylvania Studies was that classroom obser- 
vation was more effective in ^judging teacher ability than \ the MLA Teacher 
Proficiency Test > John Carroll has stated that measurement of teacher abil- 
ity "has successfully eluded several generations of educational researchers#" 
It has eluded us in Pennsylvania, too# Since the publication of the study^ 
Pennsylvania, for 6 years the only state in the nation to require the liLA 
Proficiency Test for teacher certification, has removed this obligation 
from the teachers of the Commonwealth# 

There are strong implications in this finding for the improvement 
of student teaching by frequent observation, and foi* the certification of 
teachers by seeking the judgment of qualified observers rather than asking 
for test scores and courses completed# 

are 

The finding of the Pennsylvania Study that there^ differences between 
the audio-lingual texts that are reflected in student achievement implies 
that the text which provides a greater variety of student involvement is the 
one that will teach the most# 



The widely-publicized finding that the language laboratory used twice 
a week during class time was not effective simply means that the language 
laboratory must be used as an extension of instructional time — the primary, 
reason that it has been successful at the college and university level# The 

sine q ua non that the langu^e laboratory should only be used to practice 

0 ' 

what has alreac^ been presented in class is also doubtful in light of the 
remarkable success of the Foreign Service Institute in programming cotirses 
with a "pre-study^' component presented by tape# VJe really have no research 



to 



prove that the language laboratory should not b^sed before class rather 



than afterward# 
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Lastly, the findings of the Pennsylvania Study are simply one 
of a number that are now challenging the approach to language learning 
based on Skinnerian stimulus-response psychology and the Fries-Brooks- 
Lado tagmemic -inductive grainmar approach. * It simply is not as effec- 
tive as an explicit cognitive approach with considerably more content 
and greater intellectual challenge » 

As I stated, the Pennsylvania Studies are only one of a number 
which now point in this direction. I would refer you to the recent v/ork 
of Robert Politzer at Stanford and of Chastain at Purdue. Those of you 
who have been able to compare the revised ALM with= the original model will- 
find a 180® turn from the inductive generalization -aft er-tpattern-drill to 
the explicit statement-followed-by*«practiceo 

At the conclusion of the Pennsylvania Studies I was asked by the 
Center for Curriculum Development in Philadelphia to direct a g,-year pro- 
ject in the development of instructional materials for the training of 
Peace Corps Volunteers. We were almost given carte blanche to create the 
best possible instructional package. These were intended to be the first 
official Peace Corps texts and to serve as prototypes for future texts in 
other languages. We are currently at the h^lf -way phase in producing ex- 
emplary texts in Brazilian Portuguese, French in the African context, and 
Korean. . Here I w:as given an opportunity to fully Implement *what I had 
learned from the Pennsylvania Studies. 

Briefly, bur approach has been this: 1) a systems approach to 
language learning with a precise definition of expected terminal linguis- 
tic behaviors at each level| 2) the elimination of the unimportant by 



first establishing this precise definition and then exaiaining each language 
to determine the most essential features. This 5,s based on computer analy- 
ses now available in many languages. We are currently undertaking a compu- 
ter analysis of spoken Korean. 3) We are concentrating on language for 
communication — with less emphasis on the native-like accent and more stress 
on individual communication at early stages. Yes, even communication vri-th 
error because we cannot, frustrate the learner by months of much talking but 
no saying. ' 



U) We are depending upon' the interface of visuals between languages 
to communicate both semantic and structxiral meaning. We will not hesitate 
at times to use English if it is more eff lenient or more economical. Our ma^ 
terials contain e^qjlicit grammar in both traditional and transformational 
terms. This is one of the few features actually specified as required by 
Peace Corps in our contract. . 

We are stressing an inherent knowledge of the deep structure of the . 
language and examining current linguistic thought^ not thought that was avail- 
able to the profession five to ten years ago. Our grammar will be described 
for interested linguists in transfoxinational-generative notation. While we 
are still debating as to the best method — or even the advisability — of 
introducing the' student to transformational grammar, it certainly colors the 
thinking of our production teamo We are also investigating the new concept 
of case greiaiaaf. advanced, by Fiibuore and seeking to reconcile it with what 
we can observe students doing as they; attempt to coanmunicate with an imper- . 

^ : ; feet knowledge of the language. It may be a better description of what we 
actually dp when we try to string a hew utterance together in a still-unf am- 
_iliar. tongue* : . . - ■ - 
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Our materials will contain specialized tests, have specialized 
course-specific teacher training, and provide for continued evaluation and 
immediate revision* ♦ ' 

Our Korean materials finish a two-\ireek pre-test at Falrleigh-Dickin- 
son University today; Brazilian materials begin a six-week trial in the 
state of Sao Paulo Monday; the French materials are scheduled for trial at 
the Peace Corps Training Center in the Virgin Islands this spring* VJhen 
finally accepted by Peace Corps these courses will be available to the pub- 
lic. We think that we will have the first good Portuguese course at the 
secondary level and think that a French course in an African context may be 
considex^ably more relevant to some of our \irban centers than the traditional 
concentration on Continental French culture. 

May I close with one note of caution. This past summer I was inter- 
viewed by a graduate student at Temple University who was writing the typical 
paper in an Education course. . He had choseh as his topic the Pennsylvania 
Foreign Language Research Project and had obtained a copy of the first report 
from the University library. I asked if he had available to him the second 
report and pointed out that the third report was at that time being mailed to 
interested professionals. This man responded that he did not have time diiring 
a short sxunmer course to write a paper on all of the Reports and he would be 
satisfied with simply exairiining the first. I was appalled. 

. ! Pleas^* do not either accept or reject research until you have read 

it all. Don*t let anyone tell you that the Pennsylvania Study says this 
unless he can give you chapter and verse; and don*t you teH anybody else 
that it. s^s that unless yoh can give the citation. Do not take from context 
as one critic did, beginning a quotation from page 27 , putting in the tradi- 




tional 3 dots, and concluding the quotation with page l29o That's a great 
deal of liberty to take with 3 dots* 

Much professional reaction to the Pennsylvania Studies has been, 
"The Pennsylvania Studies do not say this or that." I would like to point 
out that they do say a great deal and that what they do say is that v:e can 
never be satisfied, we can never stop improving, and we can never reach 
the point where we are beyond challenge* 
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